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What is language for? 
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Communication 

But not JUST about communication 

• emotional expression (“Oh #&@!”) 

• thought 

• identity 



• And different from animal communication systems 








Characteristics of language 

Language is . . . 

• Arbitrary: made up of learned symbols 

• Structured: governed by a system of rules 

• Generative: expresses limitless meanings 
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Characteristics of language 

Language is . . . 

• Arbitrary: made up of learned symbols 

• Structured: governed by a system of rules 

• Generative: expresses limitless meanings 
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apple, manzana, pomme, yabloko 




Characteristics of language 

Language is . . . 

• Arbitrary: made up of learned symbols 

• Structured: governed by a system of rules 

• Generative: expresses limitless meanings 


Noun Adjective Verb 
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Characteristics of language 

Language is . . . 

• Arbitrary: made up of learned symbols 

• Structured: governed by a system of rules 

• Generative: expresses limitless meanings 

• Possible English sentences with 
...less than 20 words: 10 30 
...more than 20 words: infinite! 
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Why language is amazing: 

• Amazingly DIFFICULT: 

• No other organism we know of has language or 
has been fully successful at learning language. 

• Yet young humans readily learn language and we 
use it rapidly and effortlessly throughout our lives. 
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Why language is amazing: 

• What makes it so difficult? 

• Language has many intertwined levels. 
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What it means to know a language 
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• Phonology-sounds 

• Morphology - parts of words 

• Syntax - structure 

• Semantics - meaning 

• Pragmatics - implications 


Language rules 

Phonology: 

• Language sounds and how to combine them. 

• English has 46 phonemes. 

• Other languages have a different number. 

• 200 different phonemes world-wide. 

• Certain combinations are “allowed”: 

• snart. . . okay 

• tnart... not okay 

• Sbarro . . . okay in Italian, sounds funny in English 
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Language rules 

Phonology: 

• Know lots of “rules” we are not conscious of: 

• plural of cabbage? 

• plural of lip? 

• Note the differences in the sounds you just 
produced: 

• Cabbage\z\ 

• Lip\s\ 

• These phonological representations vary across 
languages and across dialects 
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Global variation 
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• Across languages: thousands of possible 
phonemes 

• English: ~40 phonemes 

• Polynesian: ~11 phonemes 

• Khoisan: -141 phonemes 

• Some phonemes are more common across 
languages than others: 

• /m/, In/, /{/, /d/, /k/, /g/, /s/, /z/ 









Regional variation 

• Do you say these words the same or 
differently? 

• cot vs. caught? 

• pin vs. pen? 

• Don vs. dawn? 

• heel vs. hill 

• berry vs. Barry vs. bury? 

• How do you say Cool Whip? 
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Map of the caught-cot merger 
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Northern Cities Vowel Shift 


o This is an on-going shift in how vowels are pronounced. It 
primarily affects speakers from large northern industrial 
cities (Rochester, Detroit, Chicago..) 
o The shift began with the vowel lael (cad) changing to l\el 
(idea) 

o Test yourself: Say caddyshack. 
o Are the vowels the same as mine or different? 
o This shift prompted several other shifts in the vowel 
space: 

o lol in cod shifts to cad 
o /oh/ in cawed shifts to cod 
o lei in ked shifts to cud 
o cud shifts to cawed 
o HI in kid moves back to lei 










Language rules 

Morphology: 

• Parts of words that have “meaning” 

• cat... cats 

• walk . . . walked 

• We know how to do this at a general level: 

• what is the plural of ferfel? 

• . . . ferfels 

• what is the past tense of blark? 

• . . . blarked 
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Language rules 

Syntax (grammar) 

• Ways that words can (and can’t) be put together 
This sentence no verb. 

This sentence has contains two verbs. 

This is not a complete. 

This either. 

This sentence are not okay. 
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Language rules 


Semantics and pragmatics 

• Creating meaning 

• Semantics: understanding what words and 
sentences refer to 

• Relatively easy for some kinds of things 

• But much more difficult for others 

• Unicorn 

• Justice 

• The 


• Pragmatics: understanding what people mean by 
what they say 
• Can you pass the salt? 


Why language is amazing: 

• What makes it so difficult? 

• Language has many intertwined levels. 

• Lots of ambiguity. 
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Ambiguity 
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©Understanding language requires computing 
representations at multiple levels 
o sound, structure, meaning... 
oln all cases, there is more than one possibility 
for decoding. 


o How (and when) do we choose? 


Two solutions to ambiguity 

o Serial bottom-up solution 

o we process language using default rules 
(heuristics) that get things right most of the time 
o a separate stage of processing corrects errors 
using context and other non-linguistic information 
sources 

o Interactive solution 

o language is always processed using multiple 
sources of available information, including context 
and non-linguistic information 
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Dealing with ambiguity 

Models of Word Recognition: 


Serial Interactive 


sounds 


sounds 


Tt 

words 


words 

1 

1 i 

grammar 


grammar 
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Ambiguity in speech 

• Absence of clear boundaries 
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"four score and seven years ago" 

Multiple ways to divide up sounds into words 
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Top-down processing 

• Phonemic restoration effect (Warren): 

• People hear sentence where sound has been 
replaced by a cough. 

• “The state governors met with their respective 
legi*latures convening in a capital city.” 

• 19/20 subjects said no sound was missing. 

• None of the subjects could accurately locate the 
cough. 
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Gap Normal 
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Top-down processing 

• (More) phonemic restoration effect (warren): 

• Subjects heard sentences like: 

• It was found that the *eel was on the axle. 

• It was found that the *eel was on the shoe. 

• It was found that the *eel was on the orange. © 

• Again, didn’t notice missing sound. 

• Heard “wheel”, “heel”, and “peel” respectively. 
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Cohort Model (Marslen-Wilson & Tyler) 
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Words consistent with input 
become active 
— Cohort: set of words 

consistent with first syllable 
Words in the cohort are 
eliminated when they become 
inconsistent with input. 

Words also eliminated due to 
contextual incongruity. 
Processing ends when there is 
one word left in the cohort. 


/ka/ 

cat captain catch 
capitalism 
/kap/ 

captain capitalism 
Communism is not the 
same as /kap/ 
capitalism 
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Marslen-Wilson & Tyler 
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Monitor for target words 

• Normal 

The church was broken into last night. 

Some thieves stole most of the gold off the altar. 

• Syntactic 

The power was located in green water. 

No buns puzzle some in the gold off the text. 

• Random 

In was great power water the located. 

Some the no puzzle buns in gold text the off. 
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Marslen-Wilson & Tyler 
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Normal 
■ Syntactic 
Random 
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Interim summary 

• Lots of ambiguity in the speech stream. 

• Seem to use knowledge of words and their 
meanings to disambiguate. 

• Key question is when and /701/1/this top-down 
information is used. 

• Cohort model suggests that sensory analysis 
and context information are both used (but 
independently). 
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Word meaning ambiguity 

• Identifying words not enough. 

• Many words have multiple meanings: 

• / have to say that I think Pam’s real talent is getting 
wasted at her current job. She always seems to be 
loaded with work to do. Yet, she still takes the time 
to go through several drafts before she thinks her 
papers are ready for submission. Indeed, I believe 
that the number of papers she has produced (while 
staggering), does not accurately reflect her true 
ability. Thus, I would make sure there are no bars in 
the way of this woman coming to work for you. 
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Word meaning ambiguity 

• Many words have multiple meanings: 

• bank 

• river or financial institution? 

• train 

• vehicle or bridal gown part? 
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Word meaning ambiguity 

• How do we rapidly pick the right one? 

• Can use frequency: 

• more likely to encounter “train” as vehicle 

• Can use context: 

• “The maid of honor smoothed the bride’s train.” 

• “The business traveler decided to go by train.” 

• Or maybe DON’T pick ... 
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Word meaning ambiguity 

• How can we test? 

• Priming paradigm: 

• The maid of honor smoothed the bride’s train. 

• The business traveler decided to go by train. 

• After each sentence get a “probe word” that must 
rapidly respond to: 

• gown 

• engine 

• cat 

• Should get priming for any meaning that is active. 
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Word meaning ambiguity 

• Results? 

• If test immediately see priming for all 
meanings: 

• The maid of honor smoothed the bride’s train. 

• Priming for GOWN and for ENGINE. 

• If wait a short time after sentence before giving 
probe word, get priming only for contextually 
appropriate meaning: 

• Now priming only for GOWN. 

• These results are consistent with a serial, 

bottom-up view. 35 
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Ambiguity beyond words 
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• Syntactic Ambiguity 

• Sentences or phrases 
that have two or more 
interpretations because 
there are multiple ways to 
“parse” them. 

• The old man in the 
chair with the broken 
leg. 
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Syntactic “attachment” 
ambiguity 



GOO 

Good 

OOOOO 
GOOD 
OOOOO 
OOOO 
OQOO 
O G 


The old man 
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in the chair with the broken leg. 


How do we resolve the 
ambiguity?? 
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Two solutions to ambiguity 
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• Serial solution 

• use a heuristic to resolve the ambiguity 

• if the heuristic is wrong, revise your interpretation 
later 

• Interactive solution 

• use multiple top-down & bottom-up cues to figure 
out what the speaker intended 
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Context effects? 

• Example: “landing planes” 

• planes that are landing? 

• the act of landing planes? 

• Study by Tyler & Marslen-Wilson 

• If you walk too near the runway, landing planes ... 

• If you’ve been trained as a pilot, landing planes ... 

• If you walk too near the runway, landing planes ARE 

• If you’ve been trained as a pilot, landing planes IS 

• Results show that people expect contextually correct 
verb (not the same verb each time). 
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Interim summary II 

• In addition to sound ambiguities, have 
ambiguities in word meaning and the 
structure and meaning of phrases and 
sentences. 

• Evidence for both bottom-up processing and 
top-down processing: 

• bottom-up: early activation of both meanings of 
an ambiguous word 

• top-down: sentence context guides syntactic 
“parsing” 
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Discourse processing 

• In larger texts, lots of things go “unsaid”. 

• People need to make elaborative inferences -- 
filling in missing details 

• He pounded the nail in. 

• with a hammer? 

• with a shoe? 

• Do we make inferences only when we HAVE to (in 
order to make sense of language) or all the time? 
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Testing inference-drawing 

All the mugger wanted was to steal the woman’s money. 
But when she screamed, he (assaulted/stabbed) her with 
his weapon in an attempt to quiet her. He looked to see if 
anyone had seen him. He threw the knife into the bushes, 
took her money, and ran away. 

Question: do people infer that a knife was used 
when they read the word “stabbed”? 


ooo 
OOOd: 

OOO# 
OOOO 
000 0-0 
OOOO 
OOOO: 

a 


42 










Using eye-movements 
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• Look at how eyes 
move when reading. 

• Saccades: “jumps” 
from one position to 
another 

• Fixations: times when 
eyes are still 



43 


Using eye-movements 
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Our chambers were always full of chemicals and of criminal relics which had a way of wandering into unlikely positions. But 
his_papers were my great vexation. He had a horror of destroying documents, especially those which were connected with his 
past casesUndQr€Hffi^onlT^iidS > i6 > e¥ei y- f vear or Jwa that he wm&l mu ster e nergy te. docket and arrange them; for, as I 
have mentioned somewhere in these incoherent memoirs, the outbursts ofpassionate energy when he performed the 
remarkable feats with which his name is associated were followed by reactions of lethargy during which he would lie about 
with his violin and his books, hardly moving from the sofa to the table. 


• Can measure amount of time people spend 
fixating particular words. 

• Look less time for predictable words. 
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Testing inference-drawing 

All the mugger wanted was to steal the woman’s money. 
But when she screamed, he (assaulted/stabbed) her with 
his weapon in an attempt to quiet her. He looked to see if 
anyone had seen him. He threw the knife into the bushes, 
took her money, and ran away. 

Question: how long do people fixate knife? 
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Testing inference-drawing 

• If not making inferences: same with both verbs 

• If making inferences: less time after stabbed 

• Results show shorter fixation for “knife” after 
“stabbed” than after “assaulted.” 

• Suggests people already activated “knife.” 
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Conclusions 
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• Get a rapid, ambiguous, under-specified signal. 

• Must extract sounds, words, structure, meaning. 

• Two approaches. 

• Serial/bottom-up: 

• Analyze signal and apply a set of carefully chosen 
rules to maximize efficiency. 

• Use context to fix errors. 

• Interactive: 

• Use all the information you have (in signal, in memory, 
in context) as soon as you can. 

• Have principles for dealing with conflict between 
information sources. 


Question 
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Consider the following pair of sentences: 

The cop shot the spy with the gun. 

The cop arrested the spy with the stolen documents. 
What does a modular, bottom-up model predict about 
how these sentences should be parsed (interpreted) 
and what behavioral consequences that should have? 
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